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METHOD, APPARATUS, AND COMPUTER PROGRAM PRODUCT FOR 
IMPLEMENTING PACKET ORDERING 

Field of the Invention 

The present invention relates generally to the data processing field, 
and more particularly, relates to a method, apparatus, and computer 
program product for implementing packet ordering in a network processor. 

Description of the Related Art 

Packets that are transmitted from the network processor are required 
to be kept in the same order they were received. In a known network 
processor, many packets can be autorouted or processed by hardware for 
transmission on a particular transmit queue. Some packets still need to be 
processed by software instead. 

As used in the following specification and claims, an autoroute packet 
means that hardware determines the particular transmit queue for the 
packet. 

Both autoroute packets and software-handled packets need to be 
kept in order as they are transmitted, even though different processes are 
causing the enqueue for transmission to occur. 

A need exists for an effective mechanism for implementing packet 
ordering in a network processor that maintains transmission ordering for both 
autoroute packets and software-handled packets. 
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Summary of th Invention 

A principal object of the present invention is to provide a method, 
apparatus, and computer program product for implementing packet ordering 
in a network processor. Other important objects of the present invention are 
5 to provide such method, apparatus, and computer program product for 
implementing packet ordering in a network processor substantially without 
negative effect and that overcome many of the disadvantages of prior art 
arrangements. 

In brief, a method, apparatus, and computer program product are 
10 provided for implementing packet ordering in a network processor. Packets 
are received and placed on a receive queue and a queue entry is provided 
for each received packet. The queue entry includes for each autoroute 
packet, an autoroute indication and a selected transmit queue. An 
associated ordering queue is provided with the receive queue. A software- 
15 handled packet is dequeued from the receive queue and the dequeued 

software-handled packet is placed on the ordering queue. Each autoroute 
packet reaching a head of the receive queue is automatically moved to the 
selected ordering queue. 

In accordance with features of the invention, a software-handled 
20 packet is enqueued from the ordering queue to a transmit queue. Each 
autoroute packet reaching a head of the ordering queue is automatically 
moved to the selected transmit queue. 

Brief Description of the Drawings 

The present invention together with the above and other objects and 
25 advantages may best be understood from the following detailed description 
of the preferred embodiments of the invention illustrated in the drawings, 
wherein: 

FIG. 1 is a block diagram representation illustrating a network 
processor system for implementing packet ordering in accordance with the 
30 preferred embodiment; 
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FIG. 2 is a block diagram representation illustrating an exemplary 
queue structure including initial queues in the network processor system of 
FIG. 1 in accordance with the preferred embodiment; 

FIG. 3 is a block diagram illustrating an exemplary resulting queue 
structure following software packet dequeues from a first receive queue of 
FIG. 2 in the network processor system of FIG. 1 in accordance with the 
preferred embodiment; 

FIG. 4 is a block diagram illustrating an exemplary resulting queue 
structure following software packet dequeues from a second queue and 
another packet from the first receive queue of FIG. 3 in the network 
processor system of FIG. 1 in accordance with the preferred embodiment; 

FIG. 5 is a block diagram illustrating an exemplary resulting queue 
structure following software packet enqueues to transmit queues from a first 
ordering queue of FIG. 4 in the network processor system of FIG. 1 in 
accordance with the preferred embodiment; and 

FIG. 6 is a block diagram illustrating a computer program product in 
accordance with the preferred embodiment. 

Detailed Description of the Preferred Embodiments 

Having reference now to the drawings, in FIG. 1 , there is shown a 
network processor system generally designated by the reference character 
100 for carrying out methods for implementing packet ordering of the 
preferred embodiment. As shown in FIG. 1, network processor system 100 
includes a network processor 102. Network processor system 100 includes 
a control processor 104, and a dataflow processor 106 coupled by a network 
processor bus to dataflow assist hardware (HW) 108 of the preferred 
embodiment. The dataflow assist hardware (HW) 108 of the preferred 
embodiment is coupled to multiple network ports #1-N 110 for 
communicating using known network protocols, such as, an Asynchronous 
Transfer Mode (ATM), Ethernet, and the like. Network processor system 
100 includes an input/output (I/O) 112 coupled to peripheral devices. 
Network processor system 100 includes a system memory 1 14 including a 
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dynamic random access memory (DRAM) 116. 

Control processor 104 and dataflow processor 106 of network 
processor 102 can be implemented with various standard processors, for 
example, with one of the PowerPC® line of processors manufactured by 
International Business Machines Corporation. 

In accordance with features of the preferred embodiment, packets are 
received and are placed on a receive queue, along with an indication of 
being autoroute or not. For each autoroute packet, a particular ultimate 
transmit queue also is part of the queue entry. Software dequeues and 
processes each software-handled packet on the receive queue that is not an 
autoroute packet, otherwise the autoroute packet will be transmitted without 
software intervention. To keep the packets in order, when software 
dequeues a software-handled packet from the receive queue, or when the 
next packet is autoroute, the packet is placed on an ordering queue. The 
packets are maintained in the proper order on the ordering queue. When 
software enqueues sequential packets for transmission, a next packet and 
any autoroute packet or packets after the next packet on the ordering queue 
are moved to the transmit queues, so the packets are kept in order. There is 
an ordering queue associated with each receive queue so that when 
software enqueues a packet for transmission, the enqueued packet will be at 
the front of the ordering queue. 

Referring now to FIGS. 2-5, there are shown exemplary queue 
diagrams illustrating packet ordering in the network processor system 100 in 
accordance with the preferred embodiment. 

FIG. 2 illustrates an exemplary queue structure generally designated 
by the reference character 200 in the network processor system 100 in 
accordance with the preferred embodiment. As shown, queue structure 200 
includes a first receive queue 1, 202, and a second receive queue 2, 202 
together with a respective associated ordering queue 1 and 2, 204, and a 
pair of transmit queues 1 0 and 1 1 , 206. Packet numbers are shown within 
the first receive queue 1 202, and the second receive queue 2. Autoroute 
packets include also an autoroute designation A-x, where a particular 
transmit queue is represented by -x. A particular transmit queue for each of 
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the autoroute packets is identified by dataflow assist hardware 1 08 without 
software intervention. As shown, the first receive queue 1 , 202 includes 
three autoroute packets 2, 3, and 4 respectively labeled A-10, A-1 1 , and A- 
1 1 indicating autoroute to transmit queues 10 and 1 1 , 206. The second 
5 receive queue 2, 202 includes two autoroute packets 9, and 10 respectively 
labeled A-1 1 indicating autoroute to transmit queue 1 1 , 206. The associated 
ordering queues 1 and 2, 204, and transmit queues 10 and 11, 206 are 
empty. The head of the receive queue 1 , 202 is indicated by an arrow 
labeled HEAD. 

FIG. 3 illustrates an exemplary resulting queue structure generally 
designated by the reference character 300 in the network processor system 
100 in accordance with the preferred embodiment following software packet 
dequeues from the first receive queue 1 , 202 of FIG. 2. Software includes a 
pointer 302 to packet 1 in a packet segment register (PSR). In queue 
structure 300, packet 1 , and autoroute packets 2, 3, 4 respectively labeled 
A-10, A-1 1 , and A-1 1 are moved to ordering queue 1 , 204 from the first 
receive queue 1 , 202 of FIG. 2. The dequeue caused the packet 1 to be 
placed on the ordering queue 1 , 204 and also autoroute packets 2, 3, 4 
respectively labeled A-10, A-1 1 , and A-1 1 when reaching the head of the 
receive queue 1 , 202 are automatically moved to the ordering queue. 
Following the dequeue, packets 5 and 6 remain in the first receive queue 1, 
202. 

FIG. 4 illustrates an exemplary resulting queue structure generally 
designated by the reference character 400 in the network processor system 
25 100 in accordance with the preferred embodiment following software packet 
dequeues from the second receive queue 2, 202 and another packet from 
the first receive queue 1 , 202 of FIG. 3. Software includes pointers 402 to 
packets 1 , 5, and 7 in PSRs. Packet 5 is moved to ordering queue 1 , 204 
from the first receive queue 1 , 202 of FIG. 3. Packet 7 is moved to ordering 
30 queue 2, 204 from the second receive queue 2, 202 of FIG. 3. 

FIG. 5 illustrates an exemplary queue structure generally designated 
by the reference character 500 in the network processor system 100 in 
accordance with the preferred embodiment following software packet 
enqueues to the transmit queues 10 and 1 1 , 206 from the first ordering 
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queue of FIG. 4. An enqueue of packet 1 to transmit queue 10 by software, 
and moving of autoroute packets 2, and 3, 4 to respective transmit queues 
10 and 1 1 , 206 causes these packet to be removed from the ordering queue 

I, 204. Software includes pointers 502 to packets 5, and 7 in PSRs. 

5 Software must keep the packets in order, so packet 1 must be enqueued to 
a transmit queue before packet 5. Queue structure 500 illustrates 
enqueuing packet 1 to transmit queue 10, 206. The enqueue to the transmit 
queue by software causes the packet 1 to be removed from the ordering 
queue 1 , 204. Then the autoroute packets 2, 3, 4 at the head of the ordering 
10 queue 1, 204 are automatically moved to the respective transmit queues 10, 

II, 206. 

Referring now to FIG. 6, an article of manufacture or a computer 
program product 600 of the invention is illustrated. The computer program 
product 600 includes a recording medium 602, such as, a floppy disk, a high 

1 5 capacity read only memory in the form of an optically read compact disk or 
CD-ROM, a tape, a transmission type media such as a digital or analog 
communications link, or a similar computer program product. Recording 
medium 602 stores program means 604, 606, 608, 610 on the medium 602 
for carrying out the methods for implementing packet ordering of the 

20 preferred embodiment in the network processor 1 00 of FIG. 1 . 

A sequence of program instructions or a logical assembly of one or 
more interrelated modules defined by the recorded program means 604, 
606, 608, 610, direct the network processor 100 for implementing packet 
ordering of the preferred embodiment. 

25 While the present invention has been described with reference to the 

details of the embodiments of the invention shown in the drawing, these 
details are not intended to limit the scope of the invention as claimed in the 
appended claims. 
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